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Abstract — In this paper, cluster consensus of multi-agent sys- 
tems is studied via adaptive inputs. Here, we consider general 
graph topologies including time variation. The cluster consensus 
is defined by two aspects: the intra-cluster synchronization, 
that the state differences between agents in the same cluster 
converge to zero, and inter-cluster separation, that the states of 
the agents in different clusters are separated. For intra-cluster 
synchronization, the concepts and theories of consensus including 
the spanning trees, scramblingness, infinite stochastic matrix 
product and Hajnal inequality, are extended. With them, it is 
proved that if the graph has cluster spanning trees and all vertices 
self-linked, then static linear system can realize intra-cluster 
synchronization. For the time-varying coupling cases, it is proved 
that if there exists T > such that the union graph across any T- 
length time interval has cluster spanning trees and all graphs has 
all vertices self-linked, then the time-varying linear system can 
also realize intra-cluster synchronization. Under the assumption 
of common inter-cluster influence, a sort of adapted inputs are 
utilized to realize inter-cluster separation, that each agent in the 
same cluster receives the same inputs and agents in different 
clusters have different inputs. In addition, the boundedness of 
the infinite sum of the inputs can guarantee the boundedness of 
the trajectory. Numerical examples are provided to illustrate the 
availability of our results. 

Index Terms — Cluster Consensus, Multiagent System, Cooper- 
ative Control, Linear System 

I. Introduction 

In recent years, the multi-agent systems have broad appli- 
cations 0, 0, 0. In particular, the consensus problems of 
multi-agent systems have attracted increasing interests from 
many fields, such as physics, control engineering, and biology 
0, 0, 0- In network of agents, consensus means that all 
agents will converge to some common state. A consensus 
algorithm is an interaction rule how agents update their states. 
A large amount of papers concerning consensus algorithms 
have been published 0, 0, 0, Qo), HQ, most of which 
focused on the average principle,i.e., the current state of each 
agent is an average of the previous states of its own and its 
neighbors, which is implemented by communication between 
agents and can be described by the following difference 
equations for the discrete-time cases: 

n 

Xi(t + 1) = j^AjjXjjt), i = I,-- - ,n, (1) 
i=i 

where Xi(t) denotes the state of agent i and A = [Aij]™, =1 
is a stochastic matrix. For a survey, we refer readers to IU2l 
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and the references therein. 

To realize consensus, the stability of the underlying dynam- 
ical system is curial. Since the network can be regarded as 
a graph, the issues can be depicted by the graph theory. In 
the most existing literature, the concept of spanning tree is 
widely use to describe the communicability between agents in 
networks that can guarantee the consensus of 0. See |[T3ll , 

M, US). 

It is widely known that the movement or/and defaults of the 
agents may lead the graph topology changing through time. So, 
it is inevitable to study the stability of the consensus algorithm 
in a time-varying environment, which can be described by the 
following time-varying linear system: 

n 

x i (t + l) = J2A ij (t)x j {t), i = l,...,n, (2) 

where each A(t) = [Ay(i)]™ J=1 is a stochastic matrix. There 
were a lot of literature, in which the stability analysis of 
is investigated. Most of their results can be derived from the 
theories of infinite nonnegative matrix product and ergodicity 
of inhomegeneous Markov chain. Among them, the following 
should be highlighted. In lfl6l . ATI , the celebrated Hajnal's in- 
equality was introduced and its generalized form was proposed 
in |fl8l , to describe the compression of the differences between 
rows in a stochastic matrix when multiplied with another 
stochastic matrix that is scrambling. In |fl9l , it was proved that 
a scrambling stochastic matrix could be obtained if a certain 
number of stochastic matrices that have spanning trees for 
their corresponding graphs were multiplied. So, in most of 
the papers involving stability analysis of 0, their sufficient 
conditions were expressed in the terms of spanning trees in the 
union graph across time intervals of a give length. See 0, lfl31 
and the references therein. Besides, communication delays 
were also widely investigated |[14| . |20l , 12TI and nonlinear 
consensus algorithms were proposed l22l . 

All results mentioned above concern the consensus with a 
common consistent state. However, cluster consensus (syn- 
chronization) is considered to be more momentous in brain 
science 11231 and engineering control [241, ecological science 
|25l and communication, engineering [26] and social science 
l27l . and distributed computation 11281 . This phenomenon is 
observed when the agents in networks are divided into several 
groups, called clusters in this paper, by the way that all 
individuals in the same cluster reach complete synchronization 
but the dynamics in different clusters do not coincide. 

In this paper, we define the cluster consensus as follows. 
First, we divide the set of agents, denoted by V, into disjoint 



2 



clusters, C = {Ci, ■ ■ ■ ,Ck}, with the properties: 

1) C p f| C q = for each p ^ q; 

2) UjLiCp = V. 

Second, letting x(t) = [x\ (*),••• , x„(t)] T G K" denote the 
state trajectory of all agents, of which Xi(t) represents the 
state of i G V, we define cluster-consensus via the following 
aspects: 

1) x(t) is bounded; 

2) We say that x(t) intra-cluster synchronizes if 
lim t _j. 00 |xj(t) — Xi'{t)\ — for all G C p and 
p = l,--- ,K\ 

3) We say that x(t)inter-cluster separates if 
limsup^^ jxi(i) — Xj(t)\ > holds for each 
pair of i G Cfc and j G C; with k ^ I. 

We say that a system reaches a cluster consensus if each 
solution x(i) is bounded and satisfies the intra-cluster syn- 
chronization and inter-cluster separation, i.e., the items 1-3 
are satisfied. 

For this purpose, we introduce the following linear discrete- 
time system with external adapted inputs: 

n 

Xi(t+1) = ^2A ijXj (t)+I i (t), i eC p ,p= I,--- ,K, (3) 
i=i 

where A = [Aij]"j =1 is a n x n stochastic matrix, Ii(t) is 
an external scalar input and they are different with respect to 
clusters, which is used to realize inter-cluster separation. Also, 
we consider time-varying couplings that lead the following 
time-varying linear system with inputs: 

n 

Xi (t + 1) = ^2 A l0 {t) Xj (t) + Ii(t), i G C P1 

3=1 

p = l,---,K. (4) 

Related Works. However, up till now, most papers in the 
literature mainly concern the global consensus. In some recent 
papers ll29ll . 11301 . the authors addressed the cluster (group) 
consensus in networks with multi-agents and showed that (01 
can reach cluster consensus if the graph topology is fixed 
and strongly connected and the number of clusters is equal to 
the period of agents. For continuous-time network with fixed 
topology, l29l proved that under certain protocol, the multi- 
agent network can achieve group consensus by discussing the 
eigenvalues and eigenvectors of the Laplacian matrix. ll30l 
investigated group consensus in continuous-time network with 
switching topologies. However, all of these papers had a strong 
restriction in graph topologies and one important insight of 
cluster consensus: inter-cluster separation, has not been deeply 
investigated yet. 

Our Contributions. In this paper, we derive sufficient 
conditions for cluster consensus in both (01 and @). For 
this purpose, we extend the concepts and theories of graph 
and matrix such as spanning trees and scramblingness, as 
well as the transverse stability approach, to the cluster cases. 
For example, in the concept of "cluster spanning tree", we 
release the concept of "spanning tree" as that each node in 
the same cluster has a common root vertex. Under the inter- 
cluster common influence condition, we construct the cluster- 
consensus subspace and transform the cluster consensus as 



the stability of the cluster-consensus subspace. What's more, 
we provide a novel and deep concept of cluster consensus by 
three aspects, as mentioned above: the boundedness of solu- 
tions, intra-cluster synchronization and inter-cluster separation. 
Therefore, the sufficient conditions we are looking for can 
divided into three parts. The boundedness of the finite sum 
of inputs guarantee that each solution is bounded. We extend 
the celebrated Hajnal inequality to the cluster case to prove 
that intra-cluster synchronization can be achieved if the union 
graph across any T-time interval has cluster spanning tree 
and all nodes self-linked for some integer T; for inter-cluster 
separation, we prove that the trajectories in cluster-consensus 
subspace can be different for different clusters. 

This paper is organized as follows. In section 2, we present 
some graph definitions and gives some notations required 
in this paper. In section 3, we firstly investigate the clus- 
ter consensus problem in discrete-time system with fixed 
topologies and present its cluster consensus criterion. Then 
we promote the criterion to the discrete-time system with 
switching topologies in section 4. Simulations are given in 
section 5 to verify the theoretical results. We conclude this 
paper in section 6. 

II. Preliminaries 

In this section, we firstly recall some necessary notations 
and definitions that are related to graph and matrix theories and 
then generalized them into the cluster sense. We also present 
several lemmas and will be used later. For more details about 
the definitions, notations and propositions about the graph and 
matrix, we refer to textbooks 11321 . 11331 . 

For a matrix A, denote Ay the elements of A on the ith 
row and jth column. If the matrix A is denoted as the result 
of an expression, then we denote it by [A]y. A T denotes the 
transpose of A. For a set S with finite elements, #5 denotes 
the number of elements in S. E denotes the identity matrix 
with a proper dimension. 1 denotes the column vector with all 
components equal to 1 with a proper dimension. p(A) denotes 
the set of eigenvalues of a square matrix A. \\z\\ denotes a 
vector norm of a vector z and ||A| denotes the matrix norm 
of A induced by the vector norm || • ||. 

An n x n matrix A is called a stochastic matrix if Ay > 
for all i, j, and Xy=i Ay = 1 for i = 1, • • ■ , n. A stochastic 
matrix A is called scrambling if for any i and j, there exists 
k such that both A^ and Ajk are positive. 

A directed graph Q consists of a vertex set V = {1, • • • ,n} 
and a directed edge set £ C V x V, i.e., an edge is an ordered 
pair of vertices in V. Afi denotes the neighborhood of the 
vertex Vi, i.e. Af{ = {j G V : (j, i) G £}. A (directed) path of 
length I from vertex Vi to Vj, denoted by (v ri , v r2 , ■ ■ ■ , v n 
is a sequence of l+l distinct vertices v ri , ■ ■ ■ , v n+1 with v ri = 
Vi and v n+1 = Vj such that (v rk ,v rk+1 ) G £ (Q). The graph Q 
contains a spanning (directed) tree if there exists a vertex Vi 
such that for all the other vertices Vj there's a directed path 
from Vi to Vj, and Vi is called the root vertex. Corresponding to 
the matrix scramblingness, we say that Q is scrambling if for 
any pair of vertices Vi and Vj) there exists a common vertex 
k such that (vk,Vi) G £ and (vk,Vj) G £. We say that Q has 
self-links if (Vi,Vi) G £ for all Vi G V. 
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Ergodicity coefficient, /i(-), was proposed to measure the 
scramblingness of a stochastic matrix. In |fl6l , ifTTl , the Hajnal 
diameter A(-) was introduced to measure the difference of 
the rows in a stochastic matrix, and established his celebrated 
Hajnal's inequality A(AB) < (1 - p(A))A(B), which indi- 
cated that the Hajnal diameter of stochastic matrix product AB 
strictly decreases w.r.t. B, if A is scrambling, i.e., n(A) < 1. 
The definitions of p(-) and A(-) can be found in |[T6l , (18). 

An n x n nonnegative matrix A can be associated with a 
directed graph Q(A) = {V, £} in such a way that (vj, Vi) G £ 
if and only if A^ > 0. With this correspondence, we also 
say A contains a spanning tree if Q(A) contains a spanning 
tree. On the other hand, for a given graph Gi, we denote by 
A(Gi) = = Qi} the subset of stochastic matrices A 

such that Q(A) = Q\. 

For an infinite stochastic matrix sequence {A(t)} c ^ 1 with 
the same dimension, we use the following simplified symbol 
for a successive matrix product from t to s with s > t: 

A^A(s)A(s -!)■■■ A(t). 

For a constant matrix A, we denote its i-th power by A 1 . |fl9l 
proved that if each stochastic matrix A(t) has spanning trees 
and self-links, then A s t is scrambling if s — t > n — 1, where 
n is the dimension of the matrix A(t) [34]. 

In this paper, we consider cluster dynamics of networks. 
First of all, for a graph Q = (V, £), we define a clustering, C, 
as a disjoint division of the vertex set, namely, a sequence of 
subsets of V, C — {C\, • ■ • , Ck}, that satisfies: (i) (J p =i Cp = 
V; (ii) Ck Pi Ci = 0, fc ^ I. Thus, we are able extend the 
concepts of graph and matrix mentioned above to those in the 
cluster sense. 

Definition 1: For a given clustering C = {C\, ■ ■ ■ , Ck}, we 
say that the graph Q has cluster-spanning-trees with respect 
to (w.r.t.) C if for each cluster C p , p = 1, • • • , K, there exists 
a vertex v p G V such that there exist paths in Q from v p to 
all vertices in C p . We denoted this vertex v p as the root of the 
cluster C p . 

It should be emphasized that the root vertex of C p and 
the vertices of the paths from the root to the vertices in 
Cp do not necessarily belong to C p . It can be seen that the 
root vertex of a cluster does not necessarily same with other 
clusters. Therefore, the definition of the cluster-spanning-tree 
can be regarded as a generalization of that of spanning tree 
we mentioned above. 

Definition 2: For a given clustering C = {C±, • • • , Ck}, we 
say that G is cluster-scrambling (w.r.t. C) if for any pair of 
vertices v Pl , v P2 G C p , there exists a vertex Vk G V, such that 
both (vk,v pi ) and (vk,v P2 ) belong to £. 
Similarly, one can see that Definition [2] is a generalization 
of that of scramblingness we mentioned above. For a pair 
of vertices that are located in different clusters, they are not 
necessary to have a common linked vertex. 

To measure the spanning-scramblingness, as a generaliza- 
tion from those in Hanjnal |fl6l , IfTTl , we define the cluster 
ergodicity coefficient (w.r.t the clustering C) of a stochastic 



matrix A as 

N 

Pc{A) = min min Vmin(g ii: ,Sjfc)- 
p=l,— ,Ki,j<EC p f— ^ 

It can be seen that pc(A) G [0, 1] and A is cluster-scrambling 
(wxt. C) if and only if nc{A) > 0. 

According to the definition of cluster consensus, we extend 
the definition of Hajnal diameter [16), IfTTl . |[T8l to the cluster 
case: 

Definition 3: For a matrix A, which has row vectors 
A±,A2,--- , A n and a given clustering C, we define the cluster 
Hajnal diameter as 

Ac(A) = max max — A,-|| 

p=l,— ,K i.jeCp 

for some norm || • ||. 

It can be seen that Aq(x) = is equivalent to the intra-cluster 
synchronization. 

Similar to the results and the proof of Theorem 5.1 in 1341 . 
we can prove that the product of a sufficiently large number of 
stochastic matrices, all with cluster-spanning-trees, is cluster- 
scrambling. 

Lemma 1: Suppose that each A(t), t = 1, • ■ • , n — 1 is an 
n-dimensional stochastic matrix and has cluster-spanning-trees 
(w.r.t. C) and self-links. Then the product A™ -1 is cluster- 
scrambling (w.r.t. C), i.e., nc(A) > 0. 

Proof. For each cluster C p and each vertex v pi , v P2 G C p , 
let V{ and V\ be the vertices having directed links to v Pl 
and v P2 respectively via the graph Q(A\). The fact that each 
A(t) has all nodes self-linked implies that the links in A\ 
will be reserved in A* , if n — 1 > t, then the sets V\ 2 
increase respectively, that is, V* 2 C V\ + 2 respectively. In the 
following, we are going to prove that the intersection between 
V" -1 and V^" 1 is not an empty set by showing #V" _1 + 
#V2 l_1 > n. If so, we can complete the proof. 

We prove it by reduction to absurdity. First, we suppose that 
v i fl ^2 =0 for all t < n - 1. In the case of t = 1, since 
in Q(A(1)) there is a cluster root that has paths towards the 
vertices v pi and v P2 , both V{ 2 are not empty sets. Suppose 
that they do not have common vertices, which implies that 
#[V 1 1 UV 2 1 ] >2. 

For any t < n, in the graph Q(A(t + 1)) there exists a 
root vertex, denoted by v\, which has paths towards to v Pl 
and v P2 . We select their shortest paths: (v^ , Ufe 2 , • ■ ■ ,«fc P ) 
and (vi ± , vi 2 , ■ ■ ■ ,vi Q ), from v\ to v pi and v P2 respectively, 
with Ufej = vi ± = vi, Vk P = v pi and vi Q = v P2 . Under the 
assumption, at least one of the paths has at least one vertex 
not belonging to the corresponding V* or X>\. Without loss of 
generality, we assume that (v^ , vt 2 Vk P ) has vertices not 
belonging to V[ and let v ro be the index such that 

> for each r > ro, Vk r G V\; 

• v kro £ V{. 
This implies that 

[4 + V >^ ^ [ A {t + ^)K ,K -AA\]v kro _^ kp >o 

holds. This implies that v ro G V' + . Hence, 

# (V 1 U ^2 +1 ) > # (yi IJ v\\ + 1 > t + 2. 
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That is, under the assumption of Vf f] V* 2 = for all t < 
n — 1, then #[V^ +1 U^2 +1 ] strictly increases w.r.t. t. Hence, 
when t = n - 1, #[V^ +1 U V^ 1 } will be greater than n + 1, 
which implies that they should have a common vertex. This 
contradicts with the assumption, which completes the proof. 

In ||T2l . it has been proved that if a stochastic matrix A 
has spanning trees and all nodes self-linked, then the power 
matrix A n converges to la for some row vector a G R™. Here, 
we conclude that the convergence can hold even without the 
spanning tree condition as a direct consequence from |33l . 

Lemma 2: If a stochastic matrix A has positive diagonals, 
then A n is convergent exponentially. 

III. Cluster consensus analysis of discrete-time 

NETWORK WITH STATIC COUPLING MATRIX 
A. Invariance of the cluster consensus subspace 

To seek sufficient conditions for cluster consensus, we 
firstly consider the situation that if the initial data x(0) = 



[*i(o),- 



has already the cluster synchronizing 



structure, namely, Xi(0) = Xj(0) for all i,j G C p with 
p = 1, • ■ ■ , A, then the cluster synchronization should be kept 
,i.e., Xi(t) = Xj(t) for all i,j G C p with p = 1, • • • , K and 
t > 0. In other words, the following subspace in K™ w.r.t. the 
clustering C: 



) *Enl G 



for all i, j G C p with p = 1, 



A 



named cluster-consensus subspace, is invariant through ([3]). 

Definition 4: We say that the input I(t) is intra-cluster 
identical if ij (t) = Ij (t) for all i,j G C p and all p = 1 , • • • , A 
and the stochastic matrix A has inter-cluster common influence 
if for each pair of p and p', X^gc , ai i * s identical w.r.t. all 
i G C p , in other words, J2jec , a ij on ty depends on the cluster 
indices p and p but is independent of the vertex i G C p . 
One can see that if two stochastic matrices A and B which 
have inter-cluster common influence w.r.t. the same clustering 
C, then so it is with the product AB. In the following, similar 
to what we did in 135] , we present the following lemma. 

Lemma 3: If both the input is intra-cluster identical and the 
matrix A has inter-cluster common influence, then the cluster- 
consensus subspace is invariant through (O. 
Proof. From the condition, we define 

Pp-P' = a ij 

for any i G C p and I p (t) = Ii(t) for any i G C p . 

Assuming that x(t) G Sc, we are to prove x(t + 1) G Sc, 
too. For this purpose, let x p (t) be the identical state of the 
cluster p at time t. Thus, for each C p and an arbitrary vertex 

i G C p , 

K 

Xi(t+1) = ^ZYl a ijXj (t) + Ii{t) 

P' = lj£C p , 
K 

= X^p ,a vW + I p( t )> 



which is identical w.r.t. all i G C p . By induction, this completes 
the proof. 

B. Intra-cluster synchronization 

We assume a special sort of intra-cluster identical input as 
follows: 



hit) = a p u(t) 



(5) 



where u(t) is a scalar function and ai,--- ,a p are inter- 
different constants. 

We extend the Hanjnal inequality (T5), (171, ED for 
measure the intra-cluster difference after multiplied with a 
stochastic matrix. 

Lemma 4: Suppose that stochastic matrices A and B that 
both have the same dimension and inter-cluster common 
influence, then 

A C (AB) < (1- MC (A))A C (S). 

Proof. The idea of the proof is similar to that of the main 
result in JTH. Let 



B 



H = AB 



Hi 



with Bi = [B a> • • • , B in ] and H % = J2k a ik B k, denoted by 
[Ha, ■■ ■ , H m ], for all i = 1, ■ • ■ , n. 
For any pair of indices i and j both belonging to the same 



cluster C Po , we have 



H i = 



K 



K 



^ aikBk, Hj = ajkBk- 
p=i fcGC p p=i kec p 



Let dk = min{a.;fc, a,jk}. Define a set of index vector of which 
different components are selected from different clusters: 

W = {w = [wi, ■ ■ ■ ,wk] ■ w P G C p , p = 1, ■ • ■ , A}. 

For each w G W, we define a class of convex combinations 
of Bi, ■ ■ ■ , B n as follows: 

K 

G w = ^2 

p=l 



kGCp, k^Wp k£Cp, k^Wp 



Since it can be seen that both Hi and Hj are in the convex 
hull of G w for all w G W, 



\Hi -Hj\\ < max \\G V 



In fact, 



A' 



p=i fceCp 
< (l- Mc (A))A(B). 

Hence, 

\\H i -H j \\<(l-^{A))Ac(B). 

Therefore, A C (H) < (l—fj, c (A))A c {B), which completes the 
proof due to the arbitrariness of (i, j) G C p and p = 1, ■ • • , K. 
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Remark 1: Lemma indicates that if A has inter-cluster 
common influence, then the cluster-Hajnal diameter of Ax 
decreases. In addition, if A is cluster-scrambling, dc(Ax) is 
strictly less than dc(x). 

Based on the previous lemmas, we give the following result 
concerning intra-cluster synchronization of (0. 

Theorem 1: Suppose that both u(f) and 2~2k=i u{k) are 
bounded, I(t) is defined by (0, and A is a stochastic matrix 
A with inter-cluster common influence, cluster-spanning trees 
and all diagonals positive. Then for any initial condition x(0), 
(0 is bounded and intra-cluster synchronizes. 

Proof. Let x(k) = [xi(k), ■ ■ ■ ,x n (k)] T be the solution of 
(0 that can be written as: 

t 

x(t + l) = A t+1 x(0) + (6) 

fc=0 

where I(t) = <;u(£) with = [<;i, ■ ■ • , <; Tl ] T and 

Q = a p , i e C p . (7) 

There is some Y > such that \u(t)\ < Y, \ J2k=o u ( k )\ ^ Y 
hold for all t > 0. 

By Lemma0 we have A 1 = A°° + e(t), where He^)^ < 
MA* for some M > and A G (0, 1). Therefore, 

Mt + 1)|| < ||A t+1 x(0)||oo + II £ A^uWW 

fe=0 

t t 

< ||x(0)|| + ||A^|||^ w (fc)|+M^A*- fc Kfc)| 

fc=0 k=0 

< HO)!! + 11^1^ + MY r L_. 

Therefore, the solution of system (0 is bounded. 

By Lemma we can find an integer N\ such that for all 
m > N\, A m are cluster-scrambling. Denote r\ = 1 — fi(A Nl ). 
For any t, let t — pN\ + 1 with some < I < p. We have 

A c (A t+1 ) <rfA c (E n ) 

which converges to zero as t — > oo. In addition, since A 1 
has inter-cluster common influence and Ac(?) = 0, then 
Ac(A\) = for all Z > can be concluded. Therefore, 
we have Ac(x(t + 1)) < Ac(A t+1 x(0)) converges to zero as 
t — > oo. This completes the proof. 

C. Inter-cluster separation 

Under the conditions of Theorem the system can intra- 
cluster synchronize, namely, the states within the same cluster 
approach together. However, it is not known if the states in dif- 
ferent clusters will approach together, too. A simple counter- 
example is that the matrix A with the inter-cluster common 
influence has (global) spanning trees and all diagonals positive 
and the inputs <;u(i) satisfies J2T=i \ u (^)\ converges. In this 
case, the u(t) converges to zero and the influence of the input 
to the system disappears. In this case, one can see that x(t) 
reaches a global consensus, i.e., lim^oo a(t) = la for some 
scalar a. 

In this section, we investigate this problem by assuming that 
u(t) is periodic with a period T and ^fe=i ^(^) = 0' which 



guarantees that the sum of u(t) is bounded. Construct a new 
matrix: B = [p p>q ]^ q=1 , where 

Pp.q = / ] ciij, i e C p (8) 
j'ec 9 

It can be seen that (3 p , q is independent of the selection of 

i G C p . 

Furthermore, we use the concept of "genericality" from 
the structural control theory ll36l . Il37l . Il38l to investigate 
the inter-cluster separation. We define a set T(C, Q) w.r.t. a 
clustering C and a graph Q, of which each element has form: 
{B, cf, [m, ■ ■ ■ , ut-i]}, where B is defined in (0 correspond- 
ing to the graph topology g, ^ eR K is the vector to identify 
each cluster and defined as: 

<Jp = Op, P = 1, •■■ ,K, (9) 
and [ui,U2, • ■ ■ , ur-x] € R T_1 is to define the periodic input: 
u(9 + kT) =ug, 6 = l,-- - ,T-1, 

T-X 

and u(kT) = - ^ u jt V k > 0. (10) 

We can rewrite the system (0 as the following compact form: 

x(t + l)=Ax(t)+<;u(t), (11) 

where A and B has the relation as described by (0. 

Definition 5: We say that for a given set T(C, Q) as 
defined above, ( fTTT i is generically inter-cluster separa- 
tive (or cluster consensus) if for all most every triple 
{B, [ui, ■ ■ ■ , ut-i]} G T(C,Q) and almost all initial 
.t(0) G R™, (fTTT i can inter-cluster separate (or cluster con- 
sensus). 

Before presenting a sufficient condition for generic inter- 
cluster separation, we give the following simple lemma. 

Lemma 5: Suppose that the stochastic matrix A has the 
inter-cluster common influence. Then, for any pair of cluster 
C\ and C2, either there are no links from C2 to C\\ or for each 
vertex v G C\, there are at least one link from C2 to v. 

Theorem 2: Suppose that 

1) every vertex in Q has a self-link; 

2) Q satisfies the condition in Lemma w.r.t C; 

3) Q has cluster spanning trees. 

Then ( (fTTT i reaches cluster consensus generically with respect 
to the set T(C,Q). In addition, the limiting consensus trajec- 
tories are periodic, that is, there exists some scalar periodic 
trajectories v p (t) with the period T for each cluster C p , 
p =!,•■■ ,K, such that lim^oo \xj(t) — v p (t)\ = if j G C p . 

Proof. We firstly prove the asymptotic periodicity. Recall 
the solution of (0 can be written as: 

t 

x(t + 1) = A t+1 x{0) + A k qu{t - k). (12) 

fe=0 

By Lemma one can see that A n exponentially converges 
to A°°. Thus, we can find M > and A G (0, 1) such that 
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|| A 1 -A°°\\ < MX*. Let Y = max fe= i,... iT \u(k)\. Thus, we 
have 

||x(t + JT+l)-x(* + l)|| < \\{A t+lT+1 - A t+1 )x(0)\\ 



A k s[u(t + lT-k)- u(t - k)} || 

fc=0 
t+lT 

^ A k qu(t + IT -k)\\ 

k=t+l 

t+lT 

(A t+lT+1 -A t+1 )x(0)\\ + \\ ^ A°°^u{t-k)\\ 

k=t+l 

t+lT 

J2 [A k -A°°]<;u(t-k)\\ 



k=t+l 

t+lT 

< 2MA t ||x(0)|| + AfY||«|| J2 Xk 

k=t 
1 



2M||x(0)|| +MY\\s\\ 



1 - A 



A 



for all I. Letting t = mT + 9 - 1 for any m G N and 9 = 
1, • • • , T, we have 



||x((m + l)T + 6) -x(mT + 0)|| < Ah\ mT 

for some Mi > 0. According to the Cauchy convergence 
principle, each x(9 + kT), 9 = 1, • • ■ , T, converges to some 
value as k — > oo exponentially, which implies that there 
exist T-periodic functions v p (t), p — I,-- - ,K, such that 
\xj(t) — v p (t)\ — > exponentially, if j G C p . 

Now, we will prove the consensus states in different clusters 
can be different generically. 

Since each cluster synchronizes, we can pick a single vertex 
state from each cluster to represent the whole state of this 
cluster by the following way. We can divide the space M. n 
into the direct sum of two subspaces: R™ = V\ (B V2, where 
Vi denotes the right eigenspace of A corresponding to the 
eigenvalue 1 and V2 the right eigenspace of A corresponding 
to all other eigenvalues. Since all diagonals of A are positive, 
then the direct sum works and AVi C Vi holds for i = 1,2. 
In addition, since the column vectors in A°° converges Sc, 
Vi C S c . So, R" = S c +V 2 . 

For any initial data x(0) € W\ we can find y° £ Sc with 
the decompose x(0) = y Q + x(0) — y° such that x(0) — y Q € V. 
Consider the following system restricted to Sc- 

y{t + l)=Ay{t)+I{t), y(0)= y . 

where y(t) G Sc for all t. 

Let 5x(t) = x(t) - y(t) G V 2 . We have 

5x(t+ 1) = A5x(t). 

Theorem Q] tells that x(t) converges to Sc, which implies 
that limt-j.oo 6x(t) = 0, due to the direct sum property of Sc 
and V. So, we can use y(t) that belongs to Sc to represent 
x(t). 

Since each component of y in the same cluster is identical, 
we can pick a single component from each cluster to lower- 
diemnsional column vector y G M. K with y p = yi for some i G 



C p . Because of the exponential intra-cluster synchronization, 
we can write the equation for y(t) as follows: 



y(t + 1) = By(t) + cu(i) 



(13) 



where B is defined in (H)) and ^ = [a-y, • • ■ , ax] T ■ The inter- 
cluster separation can be equivalent to investigate the separa- 
tion between components of y. One can see that for almost 
every B, B has K distinguishing left eigenvectors, denoted by 
0i, • • • , 4>k, corresponding to eigenvalues V\, ■ ■ ■ ,vk (pos- 
sibly overlapping). So, for almost every B with K left 
eigenvectors, let us write down the solution ( foi l at time nT 
as follows: 

nT 

y{nT +1) = B nT+1 y(0) + ^ B nT - k qu{k) 

k=0 



Ziy(0) + as n 00, 



where 



Zi = lim B nT+1 , Z 2 



lim 



nT 

E 

fe=0 



B 



nT~k 



u{k) 



m z t 

0, we 



does exists. Combined with 
can conclude that the limit of 



From Lemma 
Z 2 exists, too. 

For an arbitrary fixed pair of (p, q), with p,q = 1, • • ■ , K 
and p ^ q, we are to show Z 2 can generically have different 
p-th and q-th components. In fact, for each k\ with \vk x \ < 1, 
noting that its associated left eigenvector is <\>^ x , we have 



nT 



T-k 



u(k) 



k=0 

T-l n-1 

fc=0 z=0 



as n —> 00. 



For each k 2 with \vk 2 \ = 1' noting its associated left- 
eigenvector is 0fc 2 , according to the fact that all diagonals 
in B is positive, from (33], we have = 1 indeed. Then, 
we have 



nT 



nT 



J2 B nT ~ k u{k) = cj) k2 ^ u(k) = (b k2 u{0) = 0k 2 u T - 



k=0 



k=0 



So, for almost [«!,••• , wt-i] G R t_1 , the eigenvectors of Z2 
are the same with B and the corresponding eigenvalues are ut 
and Y^k=o u {k) v p/(^ ~ V P )- F° r almost every reahzation of 
[uiJ^Tj 1 and B, none of them is zero, which implies that Z2 is 
nonsingular. That means that it is impossible for each pair of 
its rows to be identical. So, for almost all the p-th and g-th 
component of Z 2 are not identical. So, for almost every £, Z2C, 
has no a pair of components identical. Therefore, we conclude 
that for almost every xo, associated with almost every y(0), 
each pair of components in Ziy(0) + Z 2 C, are not identical. 

We can arbitrarily select the cluster pair (p, q) and the 
exception cases of the statements above are within a set of 
T(G, C) with Lebesgue measure zero. Since any finite union of 
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sets with Lebesgue measure zeros still has Lebesgue measure 
zero, we conclude that lim^oo y(nT + 1) has no identical 
components generically, which implies that the state of one 
cluster in linin^oo y(nT + 1) are not identical to another 
generically. This completes the proof. 

IV. Cluster-consensus in discrete-time network 

WITH SWITCHING TOPOLOGIES 

In this section, we study the cluster-consensus in network 
with switching topologies described as the following time- 
varying linear system: 

N 

xi(t + 1) = ^jWsj-c*) + v * g c f 

p=l,---,K, (14) 

where A(t) is associated with a graph from the graph set T = 
{Gi, •• • , Qm] w.r.t. a given clustering C, each of which satisfy 
the property A: for each pair p and q of cluster indices, 

1) there are not links from C q to C p in each graph Qi, I = 
1, • • • ,m, 

2) or for each vertex v E C p and each graph Qi, I = 
1 , • • • , to, there are at least one link from C q to it. 

For the matrix sequence A(t), we have the following assump- 
tions: 

• B\. There is a positive constant e > such that for each 
pair i,j and t, either Ay(i) = or Au > e holds; 

• B2' Aa(t) > e holds for all i = 1, • ■ • ,n and i > 0; 

• S3 (inter-cluster common influence): There exists a R"> n 
stochastic matrix £?(t) = [&p,g(t)]^g = i, possibly depend- 
ing on time, such that 

x;^«(*)=w*) (is) 

holds for all i £ C p and each p, g = 1 , • • • , if ; 

• £>3 (static inter-cluster common influence): There exists a 
constant W hn stochastic matrix B = [b p . q ] pq=1 , possibly 
depending on time, such that 

J2A lJ (t) = b p , q (16) 
oec q 

holds for all i E C p and each p,q = 1 , • • • , K. 

In other words, we define a graph set containing all possible 
graph induced by the matrix sequence A(t). The graph set 
satisfies the property in Lemma [5] uniformly and each graph in 
the set either never occurs in the corresponding graph sequence 
induced by A(t) or occurs frequently. For each matrix A(t), 
the nonzero elements should be greater than some constant 
independent of time and it always has positive diagonals. 

Then, we are in the position to give a sufficient condition 
for the cluster synchronization. 

Theorem 3: Suppose that A, B\, B2 and B3 hold. If there 
exists an integer L > such that for any i-length time 
interval [t, t + L), the union graph G[Y^i~tt ~ 1 ^(*)] h as cluster 
spanning trees, then the system (TBl i cluster synchronizes. 



Proof. The solution of ( fl4l i is 

t 

x(t + 1) = A{t)x{t) + <;u(t) = A%x(0) + ^ A\ +X u{t)q. 

k=0 

Noting that the diagonals of each A(t) are positive, we can 
see that the graph Q{A\ +L ~ 1 ) contains all links in the graph 
union {?(X)fc=t _1 ^(^)) an< ^ nence nas cluster spanning trees 
and positive diagonals for all t. By LemmaQ] we can conclude 
that there is an integer N such that the graph Q(A t t +NL ~ 1 ) is 
scrambling for all t > 0. Since the nonzero elements in each 
A(t) is greater than some constant e > 0, there is some 6 > 
such that 

v£nc{A\+ NL -^>8. 
Hence, for each t, we have 

A C (A^0))<(1-J)L^JA C (A(0)), 

which converges to zero as t —> 00. Here |_-J denotes the floor 
function. Therefore, lim^oo Ac(Aqx(0)) = 0. 

Combining with the fact that Ac(Af<;) = holds for all 
s > t and we can conclude that the system (TBI intra-cluster 
synchronizes. 

The inter-cluster separation can be derived by the same 
fashion of Theorem [2] 

Theorem 4: Suppose that A, B\, B2 and B$ hold. If there 
exists an integer L > such that for any i-length time 
interval [t, t + L), the union graph £/Ei=f ~ 1 Mt)\ h as cluster 
spanning trees. If the input u(t) and X)l=o u (k) are both 
bounded, then for any initial data x(0), the solution of (fl4l is 
bounded. In addition, if the input u(t) is periodic with a period 
T an satisfies Y^k=i u {k) = 0, ( [Pil l reach a cluster consensus 
generically and each trajectory converges to a T-periodic one. 
Proof. To prove the boundedness, we are to find a solution of 
(fl4l i that stays at Sc and is the limiting of x(t). Similar to the 
proof of Theorem [2] we can represent the limiting trajectory 
by a lower-dimensional linear system (fT3t . The B$ implies that 
this linear lower-dimensional system is static. So, we can prove 
its boundedness by the same way of the proof of Theorem Q] 

Define the Lyapunov exponent of the matrix sequence A(t) 
as follows: 

\{v)=m t ^J-\og(\\Alv\^j. 

From the Pesin's theory l39l , the Lyapunov exponents can 
only pick finite values and provide a splitting of R". Namely, 
there is a subspace direct-sum division: 

R' 1 = ® J 3=1 V 31 

and Ai > • • • > Xj, possibly J < n, such that for each v E Vj, 
X(v) = Xj. It can be seen that Ai = since A(t), t > 0, are 
all stochastic matrices. Let V = ®j>iVj. From the conditions, 
we claim 

Claim 1: R n = S c + V. 

We prove this claim in appendix. Therefore, for any x(0) E 
M. n , we can find a vector yo E Sc such that x(0) — yo E V. 
Define a linear system: 

y(t + 1) = A(t)y(t) + sti(t), y(0) - yo. (17) 
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Then, letting Sx(t) — x(t) — y(t), it should satisfy: 

Sx(t + 1) = A(t)Sx(t), Sx(0) = ?/(0) - x(0) € V. 

Since fe(0) G V, X(5x(0)) < 0. This implies 
limt^oo Sx(t) = 0. So, lim t _j. ocl [a;(i) — y(i)] = 0. We can 
rewrite the equation ( fTTI i as a lower-dimensional linear system: 



y(t + l) = By(t)+su(t), 



(18) 



which is same with dl3t . The £>| guarantees that the matrix 
B is static. So, the proof of boundedness of y(t) is an overlap 
of that of Theorem Q] 

In addition, since B is static, then the inter-cluster separation 
can be proved as an overlap of that of Theorem Q] Therefore, 
we can conclude that x(t) is bounded, too. This completes the 
proof. 

V. Simulation 

In this section, we give two numerical examples to il- 
lustrate the validity of the proposed theoretic results. We 
consider graphs with 9 nodes and there are three clusters: 
Ci = {1,2,3}, C 2 = {4,5,6} and C 3 = {7,8,9}. The graph 
topologies are shown in Fig[T] We simulation cluster consensus 
in discrete-time networks with the following form: 



Xi(t + 1) 

+aiu(t), 



E 

9 e{fc|Mnc fc #0} 



d 



i G C p ,p = 1,2,3, 



(19) 



where Xi(t) G R, di q denote the number of agents in set 
Mi n C q and {k\Mi D C k ^ 0} is identical to all i G C p ,p = 
1,2,3. Due to the graph topologies have self-links, we have 

dip 7^ 0,/3 pp ^ 0,Vi G C p . For any p and q G {k\Mi D 



c k * 0}, E iec , X = Zjtc, = Pp« alwa y s holds 

for Vi, i' G C p , i.e. the coupling matrices to (T% have the 
common inter-cluster influence. We denote B = [/3 pq ]p q=1 , 
which inflect the inter-cluster influence among clusters. We 
choose u(2j) = —u(2j + 1) = 1, for all j G N. 
We use 

r)(x(t)) = max \xi(t) — Xj(t)\ 

to measure the difference between clusters and 

Ac(x(t)) = max max \xi(t) ~ Xi'(t)\ 

p i,i'£C p 

to measure the difference of states in the same clusters. 
A. Static topology 

In this example, the graph is depicted in FigQ](a). We take 
the matrix B of the clustering as: 



B 



1 
1/3 1/3 1/3 
1 



and can see that the graph has cluster spanning trees and the 
roots of clusters C12.3 are 3, 3 and 7 respectively. Therefore, 
all conditions in Theorem 1 hold. Then ( fl9] l reaches cluster 
consensus generically. The dynamical behaviors of the states 
Xi(t),l < i < 9 are shown in Fig [2] (a) that asymptotically 
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(c) 



Fig. 2. The dynamical behavior of states Xi(t), A c (x(t)) and r](x(t)) with 
respect to example A with randomly picked initial values. 



converges to a periodic trajectory with period 2. In Fig |2] 
(b), the dynamical behaviors of Ac(x) is plotted. It can be 
seen that Ac (x) converges to zero quickly, which implies that 
x(t) can intra-cluster synchronize. In Fig|2](c), the dynamical 
behaviors of rj(x(t)) is indicated that does not converge to zero 
but periodically fluctuate. One can see that these states can 
inter-cluster separate. That is, (fl9l l can reach cluster consensus 
defined by the three aspects we mentioned. 

B. Switching topologies 

In this example, the graph topology is switching among the 
topologies given in Fig Q] (b),(c) and (d) periodically. Noting 
that none of these graphs has cluster spanning trees, i.e. the 
condition in Theorem Q] does not hold. However, the union 
graph of those in Fig Q] (b),(c) and (d) has cluster spanning 
trees and the roots of clusters Ci.2,3 are agents 3, 7 and 7 
respectively. We pick an identical matrix B w.r.t. the clustering 
for the three graphs as 



B 



1 

1/3 1/3 1/3 
1 



Hence, all assumptions in Theorem 4 holds. Therefore, ( fT9l 
with switching topologies can achieve cluster consensus. The 
dynamical behaviors of states Xi(t), i = 1, • • • ,9 are shown in 
Fig 03] (a), the dynamics of the intra-cluster measure Ac(x) is 
indicated in Fig [14] (b) and the inter-cluster measure r/(x(t)) 
is plotted in Fig [T4f c) respectively. All of them show that the 
cluster consensus is perfectly reached and x(t) converges to 
periodic trajectory with period 2. 



(a) 



(b) 




(fa CP 




(c) 



(d) 



Fig. 1 . All of these graphs have self -links. Example A simulate the network with fixed topology (a) and example B simulate the network with topologies 
switching in (b),(c),(d) 



VI. Conclusions 

The idea for studying consensus of multi-agent systems 
sheds light on cluster consensus analysis. In this paper, we 
study cluster consensus of multi-agent systems via adaptive 
inputs. We derive the criterions for cluster consensus in both 
discrete-time systems with fixed or switching graph topologies. 
The difference between clustered states are guaranteed by the 
adaptive inputs of different clusters. We present that if every 
cluster in the graph corresponding to the system has a spanning 
tree, then the multi-agent system reaches cluster consensus. 
The analysis is presented rigorously based on algebraic graph 
theory and matrix theory. Simple examples are provided to 
demonstrate the effectiveness of our results. 

Appendix 

In the appendix, we are to prove Claim 1 in the proof of 
Theorem [3] 

R" = S c + V. 

For this purpose, we define a R™' n nonsingular matrix P = 
[Pi," - ,P n ] with the first K column vectors composing of a 



basis of Sc- In particular, we chose each P^, k = 1, 
as 



,K, 



[P k ]i = 



1 i eC k 

otherwise. 



Then, we can make a linear transformation of the matrices 
A(t) by: 



A(t) = P~ l A(t)P 



A h i 




Ai, 2 (t) 
M,2 (t) 



where the bottom-left block equals to zero since the subspace 
Sc is invariant by A(t) and the top-left block Ai t i is a static 
matrix due to B^. Furthermore, since all eigenvalues of B, 
defined in ( fT5l ). of which the modules equal to 1 should 
equal to 1, owing to the fact that all matrices A(t) have all 
diagonal elements positive, we can select the a new linear 
transformation Q with the first several columns composing 
of the basis of the eigenspace of the static sub-matrix Ai t i 
corresponding to eigenvalue 1 and all last n — K columns 
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Fig. 3. The dynamical behavior of states X{(t), A c (x(t)) and r](x(t)) with 
respect to example B with randomly picked initial values. 



equal to ej with j > K + 1, that is, Q has the form as: 



Q = 



Qi 

I n -K 



Then, we further make linear transformation with Q over A(t) 
resulting in: 

where An has the following block form: 



ah o 

AH 



with all eigenvalues of A 1 \ equal to 1 and p(A 1 \) < 1. 
Accordingly, we write 



Ai, 2 (t) 
Thus, we define 



Al, 2 (t) 



A* 



(Ii,i)( t+1 ) K*) 

{A~2,2)l 

where ( )q denotes the left matrix product from to t, as 
defined before. 

We define the projection radius (w.r.t. C) of A(t) as follows: 

l/t 

p c (A(-))=lim^ 0O ^||(A 2 , 2 )*- 1 || 



and the cluster Hajnal diameter (w.r.t. C) of A(t) as follows: 

l/t 

A c (A(.))=lim^ 00 ^||A c (^- 1 )|| 



for some norm || • || that is induced by vector norm. It can be 
seen that the projection radius and cluster Hajnal diameter are 
independent of the selection of the matrix norm and the matrix 
P. First, we shall prove that the projection radius equals to 
the Hajnal diameter. 

Lemma 6: pc(A(-)) = A C (A(-)). 
Proof. The proof is quite similar to that in ll40l and can be 
regarded as a generalization of Lemma 2.4 in l40l . For any 
d > pc{A{-)), there exists T > such that the inequality 

<d* 



11042,2) 



i-1 1 




for all t > T. Then 

jt-i 



E K 








(Maf,- 1 

for some C > and all t > T. Thus, 



(A n y -\Aw 

< Gd l 



Al 



P 



E K 




(AuYo- 1 ,^ 



P- 



for some C\ > and all t > T. Let 



G = P 
H = 



E K 




[Pi,-" ,Pi 



(Aii)l-\A (t 



P- 



Since each Pk £ Sc for all k = 1, ■ • • , K, each column vector 
in the matrix G ■ H should belong to Sc, too. So, according 
to the definition of Hajnal diameter, we have 

AcK" 1 ) < 2C 1 d t 

for all t > T. This implies that A C (A(-)) < d. According to 
the arbitrariness of d, we have Ac(A(-)) < pc(A(-)). 

On the other hand, for any d > Ac(A(-)), there exists T > 
such that A c (^o _1 ) < d * holds for a11 1 > T - Without loss 
of generality, we suppose that the clustering C is successive, 
i.e., Ci = {1, 2, • • ■ , m}, C 2 = {ni + 1, n% + 2, • • • , n 2 },- ■ ■ , 
Ck = {nk-i + l,Hfe_i + 2, • • ■ ,uk} with tik = n. Select 
one single row in A 1 ^ 1 from each cluster and compose them 
into a matrix, denoted by H. Let G = [Pi, • • ■ , Pk] - Then the 
rows of G ■ H corresponding to the same cluster is identical. 
So, 

\\A\~ 1 -G-H\\< C 2 d l 
for some C 2 > and t > T. Then, 

WP^A^P - P^G ■ HP\\ < C 3 d* 



(^n)o- 1 




i(i-i) 

(^2,2)^ 







' Y 


Z ' 


1 











<C 3 d* 



for some matrices Y and Z, C3 > and all t > T. This 
implies that 1 1 (^l)q 1 1 1 < C 4 d t holds for some C 4 > and 
all t > T. Therefore, pc{A(-)) < d. The arbitrariness of d 
can guarantee Ac(A(-)) > pc{A{-)). From both sides, we 
have Ac{A(-)) = pc{A{-)). This complete the proof of this 
lemma. 
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From Theorem [3] we can conclude Ac(A(-)) < 1. Thus, 
pc{A(-)) < 1. Thus, for any n-dimensional vector wo, we can 
write it as: 



w 



Uq 



where zq corresponds to the sub-matrix A ± \, uq corresponds 
to the sub-matrix A^\ and vq G W n ~ K . We rewrite wq as a 



sum of Wq 



w; 



with 



" 7 1 ' 




r 7 2 i 






z 







Uq 










where z\ + Zq = zq that will be determined in the following. 
It is clear that corresponds a vector in Sc before the linear 
transformation PQ. So, if we could pick a suitable z 2 such 
that lirn t ^ oo (A) u> 2 = 0, then we would have u>q corresponds 
a vector in V before QP transformation. This could complete 
the proof of the claim. 

For this purpose, we consider the following linear system: 

w(t + 1) = A(t)w(t), w(0) = wl, 

which can be rewritten as the following component-wise form: 

A\M)w 3 (t) 



A^wx(t) 

J2.2 ~ 



Wl(t+1) 

w 2 (t + 1) = Alfw 2 (t) + A\ 2 (t)w 3 (t) 

W 3 (t+1) = A 2 ,2(t)w 3 (t) 

with iui(0) = Zq, w 2 (0) = u , w 3 (0) = v . 

It can be seen that lirrit^oo w 3 {t) = exponentially because 
of pc{A(-)) < 1 and Iiirit-^oo w 2 {t) = exponentially because 
of p(A 1 \) < 1 and the boundedness of Ai t2 (t). Without 
loss of generality, since pc(A) < 1 and all eigenvalues 
of (A^) -1 equal to 1, for any eo G (0, | A2 1 ), we have 
\\(A 2 , 2 y \\ < M 2 exp[-(|A 2 | -eo)t], IKi^)" 1 !! < exp( eo ) 
and ||il j2 WII < M o for some M o > 0, A > 0, alU > and 
some norm II • II. Note that 



wx(t) - (Al:lYz 2 + ^(Alif-'Ai^iA^ 

Since 



k=0 



IIK;i)- fe MI^, 2 (fc)l|||(i 2 ,2)g|| 

< exp(e • fc/2 - [|A 2 | - e ] • k) ■ Ml 
<cxp(-[|A 2 |-2e ]fc)Af 2 2 , 



we let 



R=^(A{f 1 )- k Al 2 (k)[A 2 , 2 ] k 

fc=0 

of which the limit exists in the norm sense and the operator 
R is well-defined. Let consider a subspace of M": 



' , u T ,v T ] 



z = —Rv 



If we pick Zq such that w^ G V, then we have 

t 



fe=0 



->■ Zn + i?w = 



exponentially as t — > 00. So, (A)qWq converges to zero 
exponentially. This completes the proof. 
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